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APPENDIX B 



Appendix B: Example Items 



After each administration of TIMSS, the IEA releases to the 
public somewhat less than half of the TIMSS items in order 
to illustrate the content of the assessment. The remaining 
items are kept secure so they can be used again in a future 
administration of TIMSS to measure trends in performance. 
This appendix contains sample mathematics and science 
items used in the U.S. administration of TIMSS 2011. These 
items have been selected from the set of released items to 
provide examples from each of the international benchmark 
levels, each of the content and cognitive domains, and each 
of the response types. 

Exhibits B.1 and B.2 below provide a key to which items are 
examples of each of these dimensions, B.1 for mathematics 
and B.2 for science. Reading exhibit B.1, for example, one 
can see that two items illustrate the Number content domain 
at grade 4 (exhibits B.5 and B.6) but that each of these 
represents a different benchmark level, a different cognitive 
domain, and a different item response type. Each item 
is presented on a separate page in this appendix. For all 
multiple choice items, the test question and "response 
options" (possible answers) are reproduced on the page 
along with the "item key" (correct answer). For all constructed- 
response items, the "scoring rubric" (the criteria for scoring) 
is reproduced along with the test question. All item pages 
also include the percentage of students who received full 
credit for their answer in each participating country or other 
education system. Note that although most constructed 
response items were worth 1 point, some were worth 2 
points with 1 point awarded for partial credit. In this appendix, 
if an example item was worth 2 points, only the percentages 
of students with responses awarded 2 points (full credit) 
are shown. 



Exhibit B-1 . Sample TIMSS 201 1 mathematics 
items, by grade level, international 
benchmark level, content domain, 
cognitive domain, and item 
response type 



Exhibit 
number, 
by grade 


International 

benchmark 

level 


Content domain 


Cognitive 
domain 


Item 

response 
type 


Grade 4 










B.3 


Low 


Data Display 


Applying 


CR 


B.4 


Intermediate 


Geometric Shapes 
and Measures 


Knowing 


MC 


B.5 


High 


Number 


Reasoning 


MC 


B.6 


Advanced 


Number 


Applying 


CR 


Grade 8 










B.7 


Low 


Number 


Knowing 


CR 


B.8 


Intermediate 


Algebra 


Knowing 


CR 


B.9 


High 


Data and Chance 


Reasoning 


MC 


B.10 


Advanced 


Geometry 


Applying 


MC 



NOTE: CR indicates constructed-response item. MC indicates multiple 
choice item. 



Exhibit B-2. Sample TIMSS 201 1 science items, by 
grade level, international benchmark 
level, content domain, cognitive 
domain, and item response type 



Exhibit 
number, 
by grade 


International 

benchmark 

level 


Content domain 


Cognitive 
domain 


Item 

response 
type 


Grade 4 










B.11 


Low 


Life Science 


Applying 


MC 


B.12 


Intermediate 


Physical Science 


Knowing 


MC 


B.13 


High 


Life Science 


Reasoning 


CR 


B.14 


Advanced 


Earth Science 


Applying 


CR 


Grade 8 










B.15 


Low 


Chemistry 


Applying 


MC 


B.16 


Intermediate 


Biology 


Knowing 


MC 


B.17 


High 


Earth Science 


Knowing 


CR 


B.18 


Advanced 


Physics 


Reasoning 


CR 



NOTE: CR indicates constructed-response item. MC indicates multiple 
choice item. 
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Exhibit B-3. Example 4th-grade mathematics item: 201 1 



International Benchmark Level 


Low 


Content Domain 


Data Display 


Cognitive Domain 


Applying 



Favorite colors of Darin's friends 



Darin asked his friends to name their favorite color. He collected the information 
in the table shown below. 



Favorite Color 


Number of Friends 


Red 


4 


Green 


2 


Blue 


6 


Yellow 


7 



Then Darin started to draw a graph to show the information. Complete 
Darin's graph. 

Favorite Color 




fellow 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 

2 Met guidelines for sample participation rates only after replacement schools were included. 

3 National Target Population does not include all of the International Target Population (see appendix A). 

4 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 

5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 

less than 25 percent. 

6 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International average 


73 


Korea, Rep. of 


97 


Singapore 1 


95 


Hong Kong-CHN : 


95 


Japan 


93 


Northern Ireland-GBR 2 


92 


Netherlands 2 


91 


England-GBR 


89 


Finland 


88 


Germany 


88 


Lithuania 1 ' 3 


87 


Ireland 


87 


Chinese Taipei-CHN 


87 


Belgium (Flemish)-BEL 


86 


Australia 


84 


Portugal 


84 


Denmark 1 


84 


Sweden 


83 


Malta 


83 


Hunqary 


83 


Russian Federation 


81 


New Zealand 


81 


Austria 


80 


Slovenia 


80 


Thailand 


78 


United States 1 


78 


Spain 


78 


Slovak Republic 


77 


Czech Republic 


77 


Italy 


77 


Bahrain 


75 


Croatia 1 


74 


Norway 4 


74 


Turkey 


73 


Kazakhstan 1 


73 


Poland 


73 


Qatar 1 


70 


Chile 


69 


United Arab Emirates 


68 


Serbia 1 


67 


Romania 


62 


Saudi Arabia 


60 


Oman 5 


57 


Georgia 3,6 


56 


Kuwait 37 


55 


Iran, Islamic Rep. of 


54 


Azerbaijan 1 ' 6 


47 


Armenia 


41 


Tunisia 5 


24 


Morocco 7 


23 


Yemen 7 


13 


Benchmarking 


Percent 


education systems 


full credit 


Quebec-CAN 


89 


Ontario-CAN 


87 


North Carolina-USA 1 ' 3 


82 


Alberta-CAN 1 


81 


Florida-USA 25 


80 


Dubai-UAE 


75 


Abu Dhabi-UAE 


62 
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Exhibit B-4. Example 4th-grade mathematics item: 201 1 



Percent 



International Benchmark Level 


Intermediate 


Content Domain 


Geometric Shapes and Measures 


Cognitive Domain 


Knowing 



Which dotted line is a line of symmetry? 



In which of the following figures is the dotted line a line of symmetry? 



B. 



C. 




1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 

2 Met guidelines for sample participation rates only after replacement schools were included. 

3 National Target Population does not include all of the International Target Population (see appendix A). 

4 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 25 percent. 

5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 

less than 25 percent. 

6 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
'Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 



Education system 


full credit 


International average 


54 


Singapore 1 


91 


Hong Kong-CHN' 1 


81 


United States 1 


80 


Australia 


76 


Korea, Rep. of 


75 


Northern Ireland-GBR 2 


74 


England-GBR 


71 


Malta 


70 


Ireland 


66 


Turkey 


65 


Denmark 1 


65 


Saudi Arabia 


65 


Germany 


64 


Iran, Islamic Rep. of 


64 


Portugal 


63 


Italy 


63 


Czech Republic 


63 


Hungary 


61 


Lithuania 1,3 


61 


Kazakhstan 1 


59 


Russian Federation 


58 


Kuwait 3 - 4 


58 


Bahrain 


57 


Oman 5 


54 


United Arab Emirates 


54 


Chile 


53 


New Zealand 


53 


Thailand 


53 


Norway 6 


52 


Azerbaijan 1,7 


52 


Romania 


50 


Qatar 1 


50 


Slovenia 


49 


Austria 


49 


Belgium (Flemish)-BEL 


49 


Finland 


49 


Spain 


48 


Georgia 3,7 


44 


Serbia 1 


43 


Chinese Taipei-CHN 


43 


Poland 


40 


Slovak Republic 


40 


Armenia 


39 


Morocco 4 


37 


Sweden 


32 


Netherlands 2 


30 


Croatia 1 


30 


Japan 


30 


Yemen 4 


27 


Tunisia 5 


22 


Benchmarking 


Percent 


education systems 


full credit 


Florida-USA 3 " 


87 


North Carolina-USA' 1 ' 3 


86 


Ontario-CAN 


76 


Alberta-CAN 1 


62 


Quebec-CAN 


62 


Abu Dhabi-UAE 


54 


Dubai-UAE 


52 
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Exhibit B-5. Example 4th-grade mathematics item: 201 1 



International Benchmark Level 


High 


Content Domain 


Number 


Cognitive Domain 


Reasoning 



Distance between towns using map 



The scale on a map indicates that 1 centimeter on the map represents 

4 kilometers on the land. The distance between the two towns on the map is 

8 centimeters. How many kilometers apart are the two towns? 

A. 2 

B. 8 

C. 16 



6 



32 



— Not available. 

1 National Target Population does not include all of the International Target Population (see appendix A). 
2 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
3 Met guidelines for sample participation rates only after replacement schools were included. 
4 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

5 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 

6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 25 percent. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 

less than 25 percent. 

8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International average 


54 


Korea, Rep. of 


84 


Chinese Taipei-CHN 


84 


Russian Federation 


80 


Lithuania"!' 2 


75 


Japan 


74 


Finland 


71 


Serbia 2 


71 


Sinqapore 2 


69 


Netherlands 3 


69 


Kazakhstan 2 


69 


Czech Republic 


67 


Azerbaijan 2,4 


66 


Croatia 2 


64 


Denmark 2 


63 


Slovenia 


63 


Northern Ireland-GBR 3 


62 


Slovak Republic 


61 


Germany 


60 


Hunqary 


59 


United States 2 


59 


Portuqal 


57 


Romania 


57 


Sweden 


57 


Austria 


57 


Poland 


57 


Norway 5 


56 


Iran, Islamic Rep. of 


55 


England-GBR 


54 


Italy 


54 


Belgium (Flemish)-BEL 


53 


Ireland 


50 


Turkey 


48 


Georgia 1,4 


47 


Australia 


46 


Spain 


46 


Armenia 


45 


New Zealand 


42 


Bahrain 


40 


Chile 


39 


Thailand 


39 


Saudi Arabia 


39 


United Arab Emirates 


37 


Qatar 2 


32 


Malta 


32 


Morocco 6 


31 


Oman 7 


31 


Tunisia 7 


31 


Yemen 6 


29 


Kuwait 1,6 


23 


Hong Kong-CHN 2 




Benchmarking 


Percent 


education systems 


full credit 


North Carolina-USA' 1 - 2 


62 


Florida-USA 1 8 


62 


Quebec-CAN 


57 


Ontario-CAN 


50 


Alberta-CAN 2 


43 


Dubai-UAE 


42 


Abu Dhabi-UAE 


33 
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Exhibit B-6. Example 4th-grade mathematics item: 201 1 



International Benchmark Level 


Advanced 


Content Domain 


Number 


Cognitive Domain 


Applying 



Recipe for 3 people 



Ingredients 


Eggs 


4 


Flour 


8 cups 


Milk 


1 

- cup 

2 



The above ingredients are used to make a recipe for 6 people. Sam wants to 
make this recipe for only 3 people. 

Complete the table below to show what Sam needs to make the recipe for 
3 people. The number of eggs he needs is shown. 



Ingredients 


Eggs 


2 


Flour 


cups 


Milk 


1 cup 



1 Met guidelines for sample participation rates only after replacement schools were included. 
2 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
3 National Target Population does not include all of the International Target Population (see appendix A). 
4 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

5 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 
less than 25 percent. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


23 


Northern Ireland-GBR 1 


63 


England-GBR 


55 


Ireland 


54 


Singapore 2 


50 


Germany 


46 


Netherlands 1 


41 


New Zealand 


39 


Belgium (Flemish)-BEL 


38 


Denmark 2 


37 


Australia 


37 


Hong Kong-CHN 2 


34 


United States 2 


33 


Malta 


31 


Finland 


31 


Chinese Taipei-CHN 


31 


Portugal 


28 


Korea, Rep. of 


28 


Serbia 2 


27 


Lithuania 2,3 


24 


Japan 


23 


Austria 


23 


Kazakhstan 2 


22 


Spain 


22 


Romania 


22 


Qatar 2 


21 


Bahrain 


20 


Azerbaijan 2,4 


20 


Russian Federation 


20 


United Arab Emirates 


20 


Hungary 


18 


Saudi Arabia 


18 


Slovenia 


17 


Poland 


16 


Norway 5 


15 


Sweden 


15 


Armenia 


15 


Chile 


15 


Italy 


14 


Georgia 3,4 


13 


Oman 6 


11 


Czech Republic 


10 


Slovak Republic 


10 


Kuwait 3,7 


8 


Turkey 


8 


Thailand 


5 


Tunisia 6 


5 


Morocco 7 


4 


Croatia 2 


3 


Yemen 7 


3 


Iran, Islamic Rep. of 


3 


Benchmarking 


Percent 


education systems 


full credit 


North Carolina-USA 2 - 3 


32 


Florida-USA 3 - 8 


31 


Dubai-UAE 


29 


Quebec-CAN 


22 


Alberta-CAN 2 


22 


Ontario-CAN 


22 


Abu Dhabi-UAE 


15 
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Exhibit B-7. Example 8th-grade mathematics item: 201 1 



International Benchmark Level 


Low 


Content Domain 


Number 


Cognitive Domain 


Knowing 



Add 42.65 to 5.748 



42.65 + 5.748 = 



Answer: 4%-3<?% 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

3 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 

4 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 25 percent. 

5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 

less than 25 percent. 

e National Target Population does not include all of the International Target Population (see appendix A). 
7 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


72 


Singapore 1 


94 


Malaysia 


91 


Hong Kong-CHN 


91 


Kazakhstan 


90 


Lithuania 1 


90 


Russian Federation 1 


90 


Chinese Taipei-CHN 


89 


United States 1 


89 


Hungary 


88 


Italy 


88 


Korea, Rep. of 


87 


Slovenia 


85 


Armenia 


84 


Tunisia 


82 


Israel 2 


82 


Australia 


82 


Norway 


81 


Lebanon 


81 


Japan 


81 


Ukraine 


80 


United Arab Emirates 


79 


Sweden 


79 


England-GBR 3 


79 


Finland 


79 


Morocco 4 


72 


Qatar 5 


72 


New Zealand 


70 


Romania 


69 


Saudi Arabia 5 


65 


Macedonia, Rep. of 5 


65 


Georgia 6,7 


64 


Thailand 


64 


Chile 


58 


Indonesia 5 


57 


Palestinian Natl Auth. 5 


56 


Oman 5 


49 


Turkey 


48 


Bahrain 5 


43 


Iran, Islamic Rep. of 5 


42 


Jordan 5 


36 


Ghana 4 


36 


Syrian Arab Republic 5 


31 




Benchmarking 


Percent 


education systems 


full credit 


Massachusetts-USA' 16 


95 


Minnesota-USA 6 


93 


Florida-USA 1 * 6 


93 


Alabama-USA 6 


92 


Connecticut-USA 1 - 6 


91 


Indiana-USA 13 


90 


North Carolina-USA 2 6 


90 


Quebec-CAN 


90 


California-USA 1 ' 6 


89 


Alberta-CAN 1 


86 


Ontario-CAN 1 


85 


Colorado-USA 6 


82 


Abu Dhabi-UAE 


81 


Dubai-UAE 


80 
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Exhibit B-8. Example 8th-grade mathematics item: 201 1 



International Benchmark Level 


Intermediate 


Content Domain 


Algebra 


Cognitive Domain 


Knowing 


Next term in the pattern 



1 2 3 4 5 

2 ' 3 ' 4 ' 5 ' 6 



A. What is the next term in this pattern? 
Answer: J? 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
3 National Target Population does not include all of the International Target Population (see appendix A). 
4 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 
less than 25 percent. 

6 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


70 


Japan 


94 


Singapore 1 


94 


Korea, Rep. of 


92 


Hong Kong-CHN 


92 


Chinese Taipei-CHN 


92 


Finland 


91 


Australia 


91 


Slovenia 


90 


Hungary 


90 


New Zealand 


89 


England-GBR 2 


89 


Sweden 


88 


Norway 


88 


United States 1 


87 


Lithuania 3 


86 


Israel 4 


85 


Italy 


85 


Ukraine 


85 


Russian Federation 1 


82 


Romania 


81 


Kazakhstan 


78 


Turkey 


77 


Tunisia 


76 


United Arab Emirates 


70 


Iran, Islamic Rep. of 5 


68 


Thailand 


68 


Armenia 


66 


Macedonia, Rep. of 5 


66 


Bahrain 5 


62 


Qatar 5 


56 


Georgia 3,6 


53 


Malaysia 


53 


Jordan 5 


45 


Syrian Arab Republic 5 


44 


Lebanon 


43 


Ghana 7 


38 


Oman 5 


37 


Palestinian Natl Auth. 5 


36 


Saudi Arabia 5 


33 


Indonesia 5 


32 


Chile 


32 


Morocco 7 


15 




Benchmarking 


Percent 


education systems 


full credit 


Massachusetts-USA 1 ' 3 


94 


Quebec-CAN 


92 


Ontario-CAN 1 


92 


Indiana-USA 1 ' 3 


91 


Alberta-CAN 1 


90 


Colorado-USA 3 


90 


Minnesota-USA 3 


90 


North Carolina-USA 3 - 4 


89 


Connecticut-USA 1 ' 3 


88 


Florida-USA 13 


87 


Alabama-USA 3 


87 


California-USA 1 ' 3 


86 


Dubai-UAE 


79 


Abu Dhabi-UAE 


68 
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Exhibit B-9. Example 8th-grade mathematics item: 201 1 



International Benchmark Level 


High 


Content Domain 


Data and Chance 


Cognitive Domain 


Reasoning 



Probability that the marble is red 



There are 10 marbles in a bag: 5 red, and 5 blue. 

Sue draws a marble from the bag at random. The marble is red. 

She puts the marble back into the bag. 

What is the probability that the next marble she draws at random is red? 



B. 



D. 



4 
10 

1 

5 

1 

10 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
3 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

"National Target Population does not include all of the International Target Population (see appendix A). 
5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 
less than 25 percent. 

6 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


45 


Singapore 1 


78 


Korea, Rep. of 


76 


Australia 


75 


England-GBR 2 


72 


Japan 


70 


Chinese Taipei-CHN 


70 


New Zealand 


68 


Slovenia 


67 


United States 1 


66 


Finland 


66 


Sweden 


65 


Norway 


64 


Hong Kong-CHN 


64 


Israel 3 


59 


Hungary 


51 


Lithuania 4 


51 


Russian Federation 1 


47 


Turkey 


44 


Italy 


42 


Macedonia, Rep. of 5 


41 


Romania 


39 


Armenia 


39 


Palestinian Natl Auth. 5 


38 


Ukraine 


38 


Kazakhstan 


38 


Thailand 


37 


United Arab Emirates 


36 


Indonesia 5 


35 


Iran, Islamic Rep. of 5 


35 


Saudi Arabia 5 


35 


Qatar 5 


34 


Georgia 46 


33 


Chile 


31 


Ghana 7 


28 


Malaysia 


28 


Jordan 5 


26 


Bahrain 5 


24 


Oman 5 


23 


Lebanon 


21 


Tunisia 


20 


Syrian Arab Republic 5 


18 


Morocco 7 


16 




Benchmarking 


Percent 


education systems 


full credit 


Massachusetts-USA 1 - 4 


79 


Minnesota-USA 4 


78 


Connecticut-USA 1 - 4 


78 


Colorado-USA 4 


76 


Indiana-USA 1 - 4 


76 


North Carolina-USA 3 - 4 


74 


Alberta-CAN 1 


73 


Ontario-CAN 1 


73 


Quebec-CAN 


72 


Florida-USA 1 - 4 


60 


California-USA 1 - 4 


60 


Alabama-USA 4 


52 


Dubai-UAE 


45 


Abu Dhabi-UAE 


34 
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Exhibit B-10. Example 8th-grade mathematics item: 201 1 



International Benchmark Level 


Advanced 


Content Domain 


Geometry 


Cognitive Domain 


Applying 



Degrees minute hand of clock turns 



How many degrees does a minute hand of a clock turn through from 
6:20 a.m. to 8:00 a.m. on the same day? 





A. 


680° 




© 


600° 




c. 


540° 


12331 


D. 


420° 


M03 







— Not available. 

1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 

2 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 

3 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 25 percent. 

4 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 

less than 25 percent. 

5 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

6 National Target Population does not include all of the International Target Population (see appendix A). 
'Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


29 


Korea, Rep. of 


63 


Japan 


58 


Singapore 1 


57 


Chinese Taipei-CHN 


56 


Hong Kong-CHN 


51 


Finland 


32 


Sweden 


31 


England-GBR 2 


31 


Slovenia 


31 


Morocco 3 


30 


Hungary 


30 


Syrian Arab Republic 4 


30 


Palestinian Natl Auth. 4 


29 


Russian Federation 1 


29 


Saudi Arabia 4 


28 


Macedonia, Rep. of 4 


28 


Turkey 


27 


Israel 5 


27 


Australia 


27 


New Zealand 


26 


Iran, Islamic Rep. of 4 


26 


Tunisia 


26 


Malaysia 


26 


Ukraine 


25 


Armenia 


25 


Italy 


25 


Jordan 4 


25 


Lebanon 


24 


Bahrain 4 


24 


Romania 


23 


Norway 


23 


Kazakhstan 


23 


United Arab Emirates 


23 


United States 1 


22 


Qatar 4 


22 


Oman 4 


21 


Lithuania 6 


21 


Ghana 3 


21 


Georgia 67 


19 


Indonesia 4 


19 


Thailand 


16 


Chile 






Benchmarking 


Percent 


education systems 


full credit 


Quebec-CAN 


30 


Minnesota-USA 6 


29 


Ontario-CAN 1 


26 


North Carolina-USA 5 6 


26 


Massachusetts-USA' 16 


25 


Dubai-UAE 


24 


Connecticut-USA 1 - 6 


24 


Abu Dhabi-UAE 


23 


Indiana-USA 1 - 6 


19 


Alberta-CAN 1 


19 


Alabama-USA 6 


18 


Colorado-USA 6 


18 


Florida-USA 1 - 6 


18 


California-USA 1 - 6 


17 
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Exhibit B-l 1 . Example 4th-grade science item: 201 1 



International Benchmark Level 


Low 


Content Domain 


Life Science 


Cognitive Domain 


Applying 



Birds/bats/butterflies share 



What do birds, bats and butterflies have in common? 



A. feathers 

B. hair 

C. internal skeleton 
wings 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
3 Met guidelines for sample participation rates only after replacement schools were included. 
4 National Target Population does not include all of the International Target Population (see appendix A). 
5 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 
less than 25 percent. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


83 


Korea, Rep. of 


99 


United States 1 


96 


Croatia 1 


95 


Singapore 1 


95 


Finland 


95 


Sweden 


95 


Ireland 


95 


Austria 


94 


England-GBR 


94 


Norway 2 


93 


Germany 


93 


New Zealand 


93 


Portugal 


92 


Russian Federation 


92 


Australia 


92 


Slovenia 


91 


Netherlands 3 


91 


Northern Ireland-GBR 3 


91 


Denmark 1 


91 


Serbia 1 


91 


Czech Republic 


90 


Poland 


90 


Slovak Republic 


89 


Italy 


89 


Lithuania 14 


89 


Belgium (Flemish)-BEL 


88 


Spain 


87 


Japan 


87 


Thailand 


86 


Georgia 45 


86 


Hungary 


84 


Chile 


84 


Armenia 


83 


Chinese Taipei-CHN 


83 


Romania 


83 


Malta 


82 


Hong Kong-CHN 1 


79 


Kazakhstan 1 


79 


Turkey 


79 


Bahrain 


75 


Azerbaijan 1 ' 5 


75 


United Arab Emirates 


74 


Saudi Arabia 


70 


Iran, Islamic Rep. of 


62 


Qatar 1 


62 


Tunisia 6 


61 


Oman 


61 


Kuwait 46 


54 


Morocco 7 


47 


Yemen 7 


31 




Benchmarking 


Percent 


education systems 


full credit 


Florida-USA 4S 


97 


Alberta-CAN 1 


96 


North Carolina-USA' 1 4 


95 


Ontario-CAN 


93 


Quebec-CAN 


92 


Dubai-UAE 


79 


Abu Dhabi-UAE 


70 
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Exhibit B-12. Example 4th-grade science item: 201 1 



International Benchmark Level 


Intermediate 


Content Domain 


Physical Science 


Cognitive Domain 


Knowing 



Temperature of ice, steam, water 



Water, ice, and steam all have different temperatures. 
What is the order from coldest to hottest? 

ice, water, steam 

B. ice, steam, water 

C. steam, ice, water 



D. steam, water, ice 



— Not available. 

1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 Met guidelines for sample participation rates only after replacement schools were included. 
3 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
4 National Target Population does not include all of the International Target Population (see appendix A). 
5 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 
less than 25 percent. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


73 


United States 1 


90 


Netherlands 2 


88 


Singapore 1 


87 


Croatia 1 


87 


Czech Republic 


86 


Hong Kong-CHN 1 


86 


Italy 


84 


Russian Federation 


84 


Serbia 1 


84 


Belgium (Flemish)-BEL 


84 


Australia 


83 


Slovak Republic 


83 


Denmark 1 


83 


Finland 


82 


Spain 


81 


Hungary 


81 


Slovenia 


80 


Chile 


80 


England-GBR 


80 


Chinese Taipei-CHN 


80 


Korea, Rep. of 


80 


Austria 


79 


Northern Ireland-GBR 2 


79 


Germany 


79 


Sweden 


79 


New Zealand 


78 


Ireland 


76 


Norway 3 


75 


Kazakhstan 1 


73 


Japan 


72 


Turkey 


71 


Romania 


71 


Bahrain 


71 


Lithuania 14 


70 


Malta 


70 


United Arab Emirates 


69 


Saudi Arabia 


67 


Azerbaijan 15 


65 


Poland 


63 


Georgia 45 


62 


Iran, Islamic Rep. of 


61 


Qatar 1 


61 


Armenia 


59 


Oman 


56 


Kuwait 46 


55 


Thailand 


55 


Tunisia 6 


41 


Morocco 7 


37 


Yemen 7 


29 


Portugal 






Benchmarking 


Percent 


education systems 


full credit 


Florida-USA^ 


94 


North Carolina-USA 1 ' 1 


90 


Alberta-CAN 1 


86 


Ontario-CAN 


85 


Dubai-UAE 


73 


Quebec-CAN 


72 


Abu Dhabi-UAE 


70 
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Exhibit B-13. Example 4th-grade science item: 201 1 



International Benchmark Level 


High 


Content Domain 


Life Science 


Cognitive Domain 


Reasoning 



Better way to travel around town 





The pictures above show two ways of traveling around town. 
A. Which way of traveling is better for the environment? 

(Check one box.) 
T^f Bicycle 
□ Motorbike 



B. Explain your answer. 



s 



t aim/ 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 

2 Met guidelines for sample participation rates only after replacement schools were included. 

3 National Target Population does not include all of the International Target Population (see appendix A). 

4 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 

5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 

because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 

less than 25 percent. 

6 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


48 


Korea, Rep. of 


83 


Croatia 1 


78 


Portuqal 


75 


Slovenia 


73 


Finland 


70 


Italy 


70 


Sweden 


68 


Hunqary 


68 


Russian Federation 


67 


Chinese Taipei-CHN 


67 


Spain 


64 


Czech Republic 


64 


Chile 


63 


Serbia 1 


62 


Germany 


62 


Iran, Islamic Rep. of 


61 


Slovak Republic 


60 


Austria 


60 


Singapore 1 


54 


Poland 


54 


Netherlands 2 


53 


Belgium (Flemish)-BEL 


53 


Romania 


51 


Lithuania 1,3 


50 


Norway 4 


49 


England-GBR 


47 


Hong Kong-CHN : 


45 


Japan 


45 


Denmark 1 


44 


United States 1 


43 


Northern Ireland-GBR 2 


43 


New Zealand 


42 


Australia 


42 


Ireland 


41 


Kazakhstan 1 


40 


Bahrain 


39 


Turkey 


38 


Thailand 


36 


Tunisia 5 


35 


United Arab Emirates 


31 


Malta 


30 


Qatar 1 


29 


Armenia 


29 


Saudi Arabia 


28 


Georgia 3,6 


28 


Morocco 7 


24 


Kuwait 3,5 


20 


Oman 


18 


Azerbaijan 1,6 


12 


Yemen 7 


4 




Benchmarking 


Percent 


education systems 


full credit 


Alberta-CAN 1 


54 


Ontario-CAN 


51 


Florida-USA 25 


46 


Quebec-CAN 


45 


Dubai-UAE 


40 


North Carolina-USA 13 


36 


Abu Dhabi-UAE 


31 



B-12 



HIGHLIGHTS FROM TIMSS 201 1 



APPENDIX B 



Exhibit B-14. Example 4th-grade science item: 201 1 



International Benchmark Level 


Advanced 


Content Domain 


Earth Science 


Cognitive Domain 


Applying 


Disadvantage to farming by a river 



The picture below shows a river flowing across a plain. 




Farming is carried out on the plain and near the river. 

There are advantages and disadvantages to farming along a river. 

B. Describe one disadvantage. 



( (ox /cj/ 



>f0 



1 Met guidelines for sample participation rates only after replacement schools were included. 
2 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
3 National Target Population does not include all of the International Target Population (see appendix A), 
not covered and no official statistics were available. 

4 Exclusion rates for Azerbaijan and Georgia are slightly underestimated as some conflict zones were not 
covered and no official statistics were available. 

5 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 
less than 25 percent. 

7 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 25 percent. 
8 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


34 


Korea, Rep. of 


64 


Czech Republic 


60 


Italy 


55 


Finland 


55 


Slovak Republic 


55 


Romania 


53 


Thailand 


52 


Chinese Taipei-CHN 


52 


Netherlands 1 


52 


Slovenia 


51 


Singapore 2 


49 


Austria 


47 


Ireland 


46 


Germany 


46 


Hong Kong-CHN 2 


45 


Denmark 2 


44 


Poland 


44 


Portugal 


44 


Hungary 


43 


Northern Ireland-GBR' 1 


43 


England-GBR 


43 


Russian Federation 


42 


Belgium (Flemish)-BEL 


39 


New Zealand 


38 


Australia 


36 


United States 2 


35 


Lithuania 2,3 


34 


Sweden 


33 


Turkey 


32 


Georgia 3 - 4 


29 


Japan 


26 


Kazakhstan 2 


25 


Azerbaijan 2,4 


25 


Norway 5 


25 


Spain 


24 


Serbia 2 


24 


Chile 


23 


Croatia 2 


22 


Iran, Islamic Rep. of 


22 


Malta 


16 


Bahrain 


15 


Armenia 


15 


United Arab Emirates 


14 


Qatar 2 


13 


Saudi Arabia 


11 


Oman 


7 


Tunisia 6 


7 


Morocco 7 


6 


Kuwait 3 ' 6 


5 


Yemen' 


1 




Benchmarking 


Percent 


education systems 


full credit 


Alberta-CAN 2 


42 


Ontario-CAN 


36 


Quebec-CAN 


35 


North Carolina-USA 2 - 3 


25 


Florida-USA™ 


24 


Dubai-UAE 


21 


Abu Dhabi-UAE 


9 
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Exhibit B-15. Example 8th-grade science item: 201 1 



International Benchmark Level 


Low 


Content Domain 


Chemistry 


Cognitive Domain 


Applying 



Which rod causes the bulb to light? 



Rods made of different materials are connected between points P and Q in the 
circuit diagram shown below. 

battery 






H Q 



Which rod would cause the bulb to light? 



6? 


copper rod 


B. 


wood rod 


C. 


glass rod 


D. 


plastic rod 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 National Target Population does not include all of the International Target Population (see appendix A). 
3 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

4 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
5 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 
less than 25 percent. 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


88 


Russian Federation 1 


97 


Hong Kong-CHN 


96 


Lithuania 2 


96 


Singapore 1 


96 


Israel 3 


95 


Slovenia 


95 


England-GBR 4 


95 


Finland 


94 


Chinese Taipei-CHN 


94 


Japan 


94 


Chile 


94 


Thailand 


93 


Sweden 


93 


Indonesia 


92 


New Zealand 


92 


Turkey 


92 


Iran, Islamic Rep. of 


91 


Italy 


91 


Morocco 


91 


United States 1 


90 


Australia 


89 


Tunisia 


88 


Korea, Rep. of 


88 


Jordan 


88 


Palestinian Nat'lAuth. 


87 


Norway 


87 


Romania 


87 


Syrian Arab Republic 


87 


Hunqary 


87 


Ukraine 


86 


United Arab Emirates 


84 


Malaysia 


84 


Bahrain 


83 


Macedonia, Rep. of 


83 


Qatar 


80 


Saudi Arabia 


80 


Kazakhstan 


80 


Georgia 25 


80 


Armenia 


79 


Lebanon 


78 


Oman 


73 


Ghana 6 


69 




Benchmarking 


Percent 


education systems 


full credit 


Alberta-CAN 1 


95 


Indiana-USA 12 


95 


Minnesota-USA 2 


93 


Massachusetts-USA' 12 


93 


North Carolina-USA 2 3 


93 


Connecticut-USA 12 


92 


Florida-USA 1 ' 2 


90 


Ontario-CAN 1 


90 


Quebec-CAN 


90 


Colorado-USA 2 


90 


Dubai-UAE 


90 


Alabama-USA 2 


87 


California-USA 1 - 2 


85 


Abu Dhabi-UAE 


83 
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Exhibit B-16. Example 8th-grade science item: 201 1 



International Benchmark Level 


Intermediate 


Content Domain 


Biology 


Cognitive Domain 


Knowing 



Cells that destroy bacteria 



Bacteria that enter the body are destroyed by which type of cells? 





white blood cells 


B. 


red blood cells 


C. 


kidney cells 


D. 


lung cells 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
3 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

4 National Target Population does not include all of the International Target Population (see appendix A). 
5 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 
less than 25 percent. 

6 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


61 


Chinese Taipei-CHN 


86 


Singapore 1 


84 


Korea, Rep. of 


80 


Italy 


78 


Japan 


77 


United States 1 


76 


Sweden 


74 


Thailand 


73 


England-GBR 2 


71 


Iran, Islamic Rep. of 


71 


Australia 


70 


Israel 3 


70 


Lithuania 4 


68 


Lebanon 


68 


Tunisia 


68 


Finland 


68 


Saudi Arabia 


67 


Kazakhstan 


67 


Hong Kong-CHN 


66 


Indonesia 


66 


Hungary 


64 


New Zealand 


62 


Romania 


60 


Macedonia, Rep. of 


60 


Syrian Arab Republic 


60 


Russian Federation 1 


59 


Qatar 


59 


Bahrain 


58 


United Arab Emirates 


57 


Armenia 


55 


Malaysia 


54 


Norway 


54 


Palestinian Natl Auth. 


52 


Chile 


48 


Jordan 


48 


Oman 


43 


Ukraine 


42 


Ghana 5 


40 


Turkey 


37 


Georgia 46 


35 


Morocco 


31 


Slovenia 


30 




Benchmarking 


Percent 


education systems 


full credit 


Indiana-USA 1 - 4 


85 


Minnesota-USA 4 


84 


Massachusetts-USA 1 - 4 


79 


Connecticut-USA' 14 


79 


North Carolina-USA 3 - 4 


79 


Florida-USA 1 - 4 


78 


Alberta-CAN 1 


77 


Ontario-CAN 1 


77 


Colorado-USA 4 


76 


Alabama-USA 4 


74 


Dubai-UAE 


70 


California-USA 1 - 4 


69 


Quebec-CAN 


60 


Abu Dhabi-UAE 


56 



B-15 



APPENDIX B 



HIGHLIGHTS FROM TIMSS 201 1 



Exhibit B-17. Example 8th-grade science item: 201 1 



International Benchmark Level 


High 


Content Domain 


Earth Science 


Cognitive Domain 


Knowing 


Volcanic eruption effects 



State one way that a volcanic eruption can affect the environment. 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 National Target Population does not include all of the International Target Population (see appendix A). 
3 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
4 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

5 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 15 percent, though it is 
less than 25 percent. 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International Avg. 


48 


Singapore 1 


81 


Slovenia 


78 


Sweden 


76 


Finland 


71 


New Zealand 


70 


Lithuania 2 


70 


England-GBR 3 


67 


Russian Federation 1 


63 


Japan 


63 


Australia 


63 


United States 1 


62 


Chile 


62 


Korea, Rep. of 


58 


Kazakhstan 


58 


Romania 


57 


Chinese Tsipei-CHN 


55 


Hong Kong-CHN 


54 


Hunqary 


54 


Norway 


49 


Turkey 


49 


Israel 4 


49 


Ukraine 


49 


Thailand 


47 


Indonesia 


45 


Saudi Arabia 


45 


United Arab Emirates 


42 


Italy 


41 


Iran, Islamic Rep. of 


37 


Georgia 2,5 


34 


Armenia 


32 


Bahrain 


32 


Jordan 


32 


Qatar 


32 


Malaysia 


32 


Macedonia, Rep. of 


31 


Palestinian Natl Auth. 


31 


Lebanon 


28 


Tunisia 


28 


Syrian Arab Republic 


27 


Oman 


26 


Morocco 


19 


Ghana 6 


9 




Benchmarking 


Percent 


education systems 


full credit 


Massachusetts-USA''' 2 


70 


Ontario-CAN 1 


67 


Colorado-USA 2 


67 


Connecticut-USA 12 


65 


Minnesota-USA 2 


65 


Florida-USA 12 


64 


Alberta-CAN 1 


61 


Indiana-USA 12 


59 


California-USA 12 


58 


North Carolina-USA 2 ' 1 


57 


Quebec-CAN 


56 


Dubai-UAE 


51 


Alabama-USA 2 


46 


Abu Dhabi-UAE 


39 
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Exhibit B-18. Example 8th-grade science item: 201 1 



International Benchmark Level 


Advanced 


Content Domain 


Physics 


Cognitive Domain 


Reasoning 



Water wheel: Faster rotation 



The diagram shows water flowing from a tank and rotating a wheel. 




tank 



C. Write one change to the system that will make the wheel rotate faster. 

Wffl' unfa /smw*. TZtl a£ 



1 National Defined Population covers 90 to 95 percent of National Target Population (see appendix A). 
2 National Defined Population covers less than 90 percent, but at least 77 percent, of National Target Population 
(see appendix A). 

3 Nearly satisfied guidelines for sample participation rates after replacement schools were included. 
4 National Target Population does not include all of the International Target Population (see appendix A). 
5 Exclusion rates for Georgia are slightly underestimated as some conflict zones were not covered and no 
official statistics were available. 

6 The TIMSS International Study Center has reservations about the reliability of the average achievement score 
because the percentage of students with achievement too low for estimation exceeds 1 5 percent, though it is 
less than 25 percent. 

NOTE: Education systems are sorted by 2011 average percent correct. The answer shown illustrates the type 
of student response that was given full credit. 

SOURCE: International Association for the Evaluation of Educational Achievement (IEA), Trends in 
International Mathematics and Science Study (TIMSS), 2011. 





Percent 


Education system 


full credit 


International average 


27 


Singapore 1 


67 


Japan 


58 


Hong Kong-CHN 


46 


Korea, Rep. of 


44 


Israel 2 


44 


Chinese Taipei-CHN 


44 


England-GBR 3 


42 


Finland 


41 


Iran, Islamic Rep. of 


40 


Turkey 


37 


Russian Federation 1 


37 


Australia 


36 


Slovenia 


35 


Hungary 


34 


Norway 


31 


Ukraine 


31 


Lithuania 4 


31 


New Zealand 


29 


United States 1 


28 


Sweden 


26 


Syrian Arab Republic 


25 


Romania 


25 


Italy 


23 


Oman 


23 


Kazakhstan 


20 


Tunisia 


20 


Palestinian Nat'lAuth. 


20 


Bahrain 


18 


Jordan 


18 


United Arab Emirates 


18 


Saudi Arabia 


17 


Macedonia, Rep. of 


17 


Qatar 


17 


Malaysia 


16 


Armenia 


16 


Georgia 45 


13 


Chile 


12 


Lebanon 


11 


Thailand 


10 


Indonesia 


9 


Morocco 


5 


Ghana 6 


3 




Benchmarking 


Percent 


education systems 


full credit 


Massachusetts-USA' 1 4 


37 


Minnesota-USA 4 


35 


Alberta-CAN 1 


35 


Colorado-USA 4 


33 


Connecticut-USA 1 - 4 


33 


Ontario-CAN 1 


32 


Quebec-CAN 


31 


Indiana-USA 14 


25 


Florida-USA 14 


25 


Dubai-UAE 


24 


North Carolina-USA 2 - 4 


23 


Alabama-USA 4 


17 


California-USA 1 - 4 


17 


Abu Dhabi-UAE 


17 
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